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DETAILED ACTION 



Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.114, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1,1 14. Applicant's submission filed on May 24m 2007 has been entered. 



Response to Arguments 

2. Applicant's arguments filed May 24, 2007 have been fully considered but they are not 
persuasive. 

3. Applicant initially argues, "Lyons does NOT disclose or suggest extracting a partial 
image in which only objects in the searching range is shown". 

4. The Examiner respectfully submits neither independent Claim 1 nor 22 necessarily 
require "extracting a partial image in which only objects in the searching range is shown". For 
instance, Claim 1 requires, "a partial image extracting unit for extracting a partial image 
including said main subject from said image data". The language of Claim 1 does not prevent 
other subjects in addition to the main subject from being included in the partial image. 
Therefore, the Examiner respectfully disagrees with Applicant's position. 
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5. Applicant subsequently concludes, "the references do not disclose or suggest a main 
subject detecting unit for detecting the main subject from the partial image, as now recited in 
amended independent claim 1 and independent claim 22." 

6. The Examiner respectfully notes Applicant has not provided any evidence to support the 
above-conclusion. Hence, Applicant's assertion amounts to a general allegation that the claims 
define a patentable invention without specifically pointing out how the language of the claims 
patentably distinguishes them from the references. Therefore, the Examiner respectfully 
disagrees with Applicant's position. 

7. The Examiner maintains that Lyons discloses a main subject detecting unit (15/222) for 
detecting a main subject (21) from said partial image ("central region 26") and receiving main 
subject information (see column 7, line 55 - column 8, line 22). 

Claim Rejections - 35 USC § 103 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

9. Claims 1, 2, 5 - 10, 14, 22 - 26, and 30 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Lyons (US 6 734 91 1 Bl) in view of Anderson (US 7 106 376 Bl). 

The Examiner believes independent Claims 1 and 22 are corresponding apparatus and 
method claims, respectively. Accordingly, they will be rejected together. 
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10. For Claims 1 and 22, Lyons discloses, as shown in figures 1 A, 2A, 2B, and 8B, an image 
processing apparatus (14 - figure 1 A), comprising: 

an image data input unit (17) for inputting image data (28) of a plurality of objects (21, 
21a, 22, and 23) including a main subject (21 - see column 5, lines 42-51); 

a range setting unit (15) for restricting a searching range in the depth direction (either 
"wide-angle field of view" 27 or "narrow-angle field of view" 26; see column 5, lines 33-40 
and 64 - 67 and column 10, lines 46 - 62; Lyons clearly shows that the search range is restricted 
to a single predetermined distance from the image data input unit to the plurality of objects.) for 
searching said main subject (21) from the plurality of objects (21,21a, 22, and 23) using the 
input image data (28); and 

a partial image extracting unit (15/222) for extracting a partial image ("central region 26" 
or "peripheral region 27") including said main subject (21) from said image data, a depth 
direction of said partial image being restricted to said searching range set by said range setting 
unit (see column 7, lines 55 - 65, column 8, line 1 1 - 22, and column 10, lines 46 - 62); and 

a main subject detecting unit (15/222) for detecting a main subject (21) from said partial 
image ("central region 26") and receiving main subject information (see column 7, line 55 - 
column 8, line 22). 

While Lyons discloses restricting the searching range to a single predetermined distance, 
either a depth of field corresponding to a "wide-angle" FOV 27 or a "narrow-angle" FOV 26, in 
the depth direction for search a main subject from the plurality of objects; Lyons is silent with 
respect to extracting the main subject based on depth distribution information indicating a 
distance to each of said plurality of objects included in said image data. 
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On the other hand, Anderson also discloses an image processing apparatus including a 
range setting unit and an image extracting unit for extracting said main subject from within the 
set searching range. Specifically, Anderson teach, as shown in figures 1, 3 A, 3B, 4B, an image 
processing apparatus including a range setting unit and an image extracting unit for extracting 
said main subject (e.g., 504) from among a plurality of objects (e.g., 502, 508, and 506) from 
within the set searching range (500). Anderson further teaches, as shown in figure 7 and as 
stated in column 8 (line 1) - column 9 (line 57), extracting the main subject (504) from the 
image data (500) based on depth distribution information (see figure 6A) indicating a distance to 
each of said plurality of objects included in said image data (see column 8,lines 1-13). 

Hence, at the time invention was made, it would have been obvious to one with ordinary 
skill in the art to have included the extracting the main subject from the image data based on 
depth distribution information indicating a distance to each of said plurality of objects included 
in said image data (as taught by Anderson) in the image processing apparatus (disclosed by 
Lyons) for the advantage of reducing undesirable image characteristics and improve image 
quality (see column 1, lines 61 and 62). 

11. As for Claim 2, Lyons discloses, as shown in figure 1A, wherein said image data input 
unit comprises a means for inputting a parallactic image ("different focal lengths in the radial 
and tangential planes"; see column 5, lines 53 - 57), which picks up an image of the plurality of 
objects (21,21a, 22, and 23) from a plurality of different perspectives, and the image processing 
apparatus (222) further comprises a depth distribution information receiving unit for receiving 
said depth distribution information based on said parallactic image (28). 
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12. As for Claims 5 and 23, Lyons discloses, as shown in figures 1 A, 2A, 2B 5 and 8B and as 
stated in column 10 (lines 46 - 62), said range setting unit (15) comprises a means for setting a 
first searching range ("narrow-angle field of view" 26) and a means for setting a second 
searching range ("wide-angle field of view" 27), which differs from said first searching range 
(see column 5, lines 61 - 67); 

said partial image extracting unit (15/222) comprises a means for extracting the part of 
the plurality of objects (21,21a, 22, and 23) included in said first searching range (Step S91) as a 
partial image and a means for extracting the part the plurality of objects (21,21a, 22, and 23) 
included in said second searching range (Step S93) as a second partial image; and 

said main subject detecting unit (15/222) comprises a means for detecting (Step S91) said 
main subject (21) from said first partial image and a means for detecting (Step S93) said main 
subject (21) from said second partial image when said main subject is not detected from said first 
partial image (see figure 8B). 

13. As for Claim 6, Lyons discloses, as shown in figure 8B, wherein said range setting unit 
(15) sets a predetermined depth length ("narrow-angle field of view") as said first searching 
range and sets the depth length contiguous (see column 7, line 55 - column 8, line 22; and 
column 10, lines 46 - 62) to said first searching range as said second searching range. 

14. As for Claims 7, 8, 24, and 25, Lyons discloses as stated in column 5 (lines 52 - 57), 
wherein said range setting unit (15) sets the depth length ("narrow-angle field of view"), which 
includes an independent object (21) existing at the nearest distance (i.e., zoomed-in), as said first 
searching range based on a depth distribution information (see column 5, lines 52 - 57) and sets 
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the depth length contiguous to said first searching range as said second searching range (see 
figure 8B). 

15. As for Claim 9, Lyons discloses, as indicated above, said range setting unit (15) sets a 
different said searching range (Step S93) when said main subject is not detected (Step S92) in 
said searching range set by said range setting unit (15); said partial image extracting unit extracts 
again (Steps S91) said partial image; and detects again said main subject. 

16. As for Claims 10 and 26, Lyons discloses, as shown in figures 8B and as stated in 
column 10 (lines 46 - 62), wherein said image data input unit is an image capturing unit (17/51) 
for picking up an image of the plurality of objects (21,21a, 22, and 23), comprising: a 
photographic condition setting unit (15) for setting a photographic condition (zoom condition) 
based on said main subject information; and an image capturing control unit for controlling 
imaging by said image capturing unit based on said photographic condition (see figure 8B). 

.17. As for Claims 14 and 30, Lyons inherently discloses wherein said image data input unit 
is an image capturing unit, which captures an image of said object based on a photographic 
timing signal. However, Lyons is silent with respect to setting a photographic timing condition 
relating to the main subject, wherein said photographic timing is predetermined and stored. 

However, Official Notice (MPEP § 2144.03) is taken that both the concepts and 
advantages of providing a timing condition storing unit for storing a predetermined photographic 
timing condition relating to said main subject; and a timing signal output unit for outputting said 
photographic timing signal to said image capturing unit when said main subject satisfies said 
photographic timing condition are well known and expected in the art. At the time the invention 
was made, it would have been obvious to one with ordinary skill in the art to have a timing 
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condition storing unit for storing a predetermined photographic timing condition relating to said 
main subject; and a timing signal output unit for outputting said photographic timing signal to 
said image capturing unit when said main subject satisfies said photographic timing condition for 
the advantage optimizing exposure and dynamic range of the main subject. 

1 8. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Lyons in view of 
Anderson in further view of Hanna et al. (US 6 714 665 Bl), 

19. As for Claim 4, Lyons (as modified by Anderson) discloses a main subject detecting unit 
(15/222) for detecting a main subject (21) from said partial image ("central region 26") and 
receiving main subject information. 

However, Lyons (as modified by Anderson) does not disclose a distinctive parts detecting 
unit for detecting from said partial image, a distinctive part, which should be included in said 
main subject; and an information receiving unit for receiving said main subject information 
based on the position of said distinctive part detected by said distinctive parts detecting unit. 

On the other hand, Hanna et al. also disclose an image processing apparatus including an 
image data input unit, a range setting unit, and a partial image extracting unit. Mores 
specifically, Hanna et al. teach, as shown in figures 1A and IB, a distinctive parts detecting unit 
(computer 20) for detecting from said partial image (NFOV camera 14), a distinctive part 
("user's eye" - see figure IB), which should be included in said main subject; and an 
information receiving unit (18) for receiving said main subject information based on the position 
of said distinctive part detected by said distinctive parts detecting unit (see column 5, lines 40 - 
51 and column 7, lines 17 - 30). 
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As stated in column 1 (lines 50 - 53) of Hanna et al., at the time the invention was made, 
it would have been obvious to one with ordinary skill in the art to have included a distinctive 
pars detecting unit and an information receiving unit (as taught by Hanna et al.) in the image 
processing apparatus (disclosed by Lyons - as modified by Anderson), for the advantage 
"identifying objects of individuals in a passive way that is both fast and accurate." 



Conclusion 

20. All claims are drawn to the same invention claimed in the application prior to the entry of 
the submission under 37 CFR 1.114 and could have been finally rejected on the grounds and art 
of record in the next Office action if they had been entered in the application prior to entry under 
37 CFR 1.114. Accordingly, THIS ACTION IS MADE FINAL even though it is a first action 
after the filing of a request for continued examination and the submission under 37 CFR 1.114. 
See MPEP § 706.07(b). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 CFR 
1.136(a) will be calculated from the mailing date of the advisory action. In no event, however, 
will the statutory period for reply expire later than SIX MONTHS from the mailing date of this 
final action. 
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21 . Any inquiry concerning this communication or earlier communications from the 
Examiner should be directed to Justin P Misleh whose telephone number is 571 .272.731 3. The 
Examiner can normally be reached on Monday through Friday from 8:00 AM to 5:00 PM. 

If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, Lin Ye can be reached on 571.272.7372. The fax phone number for the organization 
where this application or proceeding is assigned is 571.273.8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



JPM 

July 27, 2007 
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